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ABSTRACT 


Aircraft  carriers  are  the  eenterpieee  of  the  United  States  Navy.  The  primary  weapon  system 
of  the  aireraft  earner  is  the  attaehed  airwing  and  the  eombat  power  provided  by  its  various 
arreraft.  The  airwing  is  only  effeetive  while  airborne  and  thus  dependent  on  the  skill  and 
training  of  a  small  number  of  launeh  offieers  known  as  “shooters.”  Shooter  training  is  ae- 
eomplished  on-the-job  and  often  requires  the  launeh  offieers  to  go  underway  on  different 
arreraft  earriers,  at  the  expense  of  their  parent  eommand,  in  order  to  eomplete  their  qualifi- 
eations.  This  thesis  addresses  the  laek  of  alternative  environments  available  for  shooters  to 
hone  their  skills.  The  results  of  a  job  task  analysis  provide  insight  into  the  skills  required 
to  perform  the  duties  of  a  launeh  offieer.  Analysis  of  the  data  gathered  from  the  job  task 
analysis  produeed  a  flowehart  that  ean  be  represented  as  a  finite  state  maehine  and  then  re- 
produeed  in  a  virtual  environment.  A  virtual  environment  was  then  ereated  utilizing  eurrent 
virtual  reality  hardware  and  software  to  faithfully  re-ereate  an  environment  that  presented 
the  required  attributes  and  seenarios  to  aeeomplish  the  tasks  of  a  launeh  offieer.  This  thesis 
yields  a  low-eost,  portable,  and  safe  alternative  environment  for  shooters  to  perform  the 
skills  required  for  their  training. 
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CHAPTER  1: 

Introduction 


The  primary  weapons  system  on  the  aircraft  carrier  is  the  carrier  airwing,  which  consists  of 
approximately  80  aircraft  with  varying  capabilities.  These  aircraft  and  their  highly  trained 
crews  cannot  complete  their  missions  while  parked  on  the  carrier.  Aboard  the  aircraft  car¬ 
rier,  the  air  department  is  responsible  for  ensuring  that  the  aircraft  of  the  airwing  are  fueled, 
positioned,  launched,  and  recovered  safely  on  the  ship.  Of  the  approximately  800  personnel 
composing  the  air  department,  only  a  small  group  of  officers,  roughly  10,  are  qualified  to 
launch  aircraft  from  the  carrier.  These  officers  are  the  catapult  and  arresting  gear  officers, 
known  as  “shooters,”  and,  therefore,  these  officers  are  vital  to  the  success  of  the  airwing. 
Shooters  complete  an  initial  three-week  training  course  in  Lakehurst,  NJ,  which  focuses 
on  the  catapult  and  arresting  gear  systems.  After  completion  of  this  course  the  officers 
report  to  their  ship  and  all  training  for  shooter  qualifications  is  conducted  via  On-the-Job 
Training  (OJT)  in  accordance  with  a  standardized  Navy  training  and  qualification  manual 
entitled  Personnel  Qualification  Standard  (PQS).  In  order  to  complete  this  training  and 
become  qualified,  they  have  to  perform  operations  underway  with  aircraft.  A  considerable 
amount  of  time,  effort,  and  resources  are  expended  by  the  personnel  within  the  air  depart¬ 
ments  of  different  ships  arranging  to  have  their  personnel  embark  on  carriers  to  conduct 
training. 


1.1  Problem  Statement 

Shooters  are  essential  for  flight  operations  on  an  aircraft  carrier.  Despite  their  critical  func¬ 
tion,  there  are  no  onboard  simulation  or  training  devices  for  shooters.  If  the  aircraft  carrier 
to  which  the  shooter  is  assigned  is  in  port,  in  the  shipyard,  or  underway  without  the  airwing 
embarked,  there  is  no  shooter-specific  training  available  to  them.  Carriers  that  will  be  in  the 
shipyard  for  a  long  period,  such  as  during  a  Planned  Incremental  Availability  (PIA),  will 
send  their  unqualified  shooters  underway  with  another  ship  which  is  conducting  training 
with  an  airwing  or  training  command  in  order  to  get  OJT  and  qualifications.  Once  quali¬ 
fied,  shooters  do  not  receive  any  proficiency  or  currency  training.  In  short,  launch  officers 
would  benefit  from  a  low-cost,  deployable,  tool  for  training  and  proficiency. 
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1.2  Research  Questions 

1.  What  are  the  essential  skills  required  for  an  offieer  to  qualify  as  Arresting  Gear  Offi- 
eer,  Bow  Catapult  Officer,  and  Waist  Catapult  Officer? 

2.  Based  on  current  training  literature,  which  of  these  candidate  skills  can  be  trained 
effectively  in  a  virtual  environment? 

3.  What  technical  attributes  does  a  system  need  to  adequately  represent  the  shooter 
environment  for  training? 

4.  Do  current  and  emerging  systems  possess  the  requisite  attributes  for  use  in  a  shooter 
training  environment? 

1.3  Scope  and  Limitations 

This  thesis  involves  performing  a  job  task  analysis  to  determine  the  skills  required  for  a 
launch  officer  to  perform  their  duties  and  an  assessment  of  which  skills  and  tasks  can  be 
effectively  performed  and/or  practiced  in  a  virtual  environment.  Additionally,  an  assess¬ 
ment  of  current  technologies  to  determine  the  appropriate  platform  for  a  shooter  virtual 
environment  is  conducted.  Finally,  a  virtual  environment  is  developed  for  those  platforms 
which  meets  the  requirements  identified  in  the  first  two  steps.  This  virtual  environment  will 
not  be  a  final  training  system,  but  rather  a  prototype  to  allow  human  testing  which  should 
result  in  a  final  design  and  implementation  for  fleet  use. 


1.4  Benefits  of  this  Study 

We  hypothesize  that  a  virtual  environment  for  shooters  can  provide  the  following  benefits: 

•  Increased  training  opportunities  for  unqualified  shooters. 

•  Decreased  OJT  time  to  achieve  fully-qualified  status. 

•  Proficiency  maintenance  for  fully-qualified  shooters  in  the  time  frame  between  un¬ 
derway  periods. 

•  The  ability  to  conduct  controlled  training  scenarios,  including  emergency  procedures, 
in  a  safe  environment  instead  of  reacting  to  actual  situations  as  they  may  (or  may  not) 
present  themselves  during  OJT. 
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1.5  Thesis  Organization 

The  remainder  of  this  thesis  is  organized  into  six  chapters. 

Chapter  2  provides  the  background  of  the  research.  It  contains  a  detailed  description  of 
current  shooter  training,  training  requirements,  and  describes  the  problems  encountered  in 
the  current  training  system. 

Chapter  3  provides  the  academic  justification  for  this  thesis:  a  literature  review  exploring 
the  transferability  of  skills  from  the  virtual  to  actual  environments.  In  addition  to  the  trans¬ 
fer  of  skills,  the  organization  and  description  of  job  tasks  are  discussed.  Finally,  three  main 
virtual  environment  technologies  are  examined  in  context  of  current  capabilities  and  the 
questions  posed  by  this  thesis. 

Chapter  4  describes  the  methodologies  used  to  perform  the  job  task  analysis  and  creation 
of  the  virtual  environment. 

Chapter  5  consists  of  the  evaluation  of  the  job  task  analysis,  how  the  results  were  used  in 
the  development  of  the  virtual  environment,  and  the  results  of  the  creation  of  the  virtual 
environment. 

Chapter  6  contains  conclusions  from  this  research  and  a  discussion  of  future  research  efforts 
that  should  be  conducted  to  extend  the  findings  of  this  thesis. 


3 


THIS  PAGE  INTENTIONALLY  LEET  BLANK 


4 


CHAPTER  2: 
Background 


The  Aircraft  Launch  and  Recovery  Officers  known  as  “Shooters”  are  responsible  for  the 
safe  launch  and  recovery  of  aircraft  from  the  flight  deck  of  a  United  States  Nuclear  Aircraft 
Carrier  (CVN)  [1].  This  chapter  defines  the  training  requirements  and  describes  the  current 
training  methods  to  qualify  shooters. 

2.1  Training  Overview 

According  to  the  PQS,  shooter  qualification  is  conducted  through  OJT  .  This  training 
method,  while  effective,  requires  the  CVN  and  aircraft  to  be  underway  performing  launch 
and  recovery  operations.  While  the  CVN  is  in  port  or  underway  not  performing  flight 
operations,  for  example  during  Operational  Reactor  Safeguard  Examination  (ORSE)  where 
the  purpose  of  the  underway  is  to  conduct  reactor  drills  and  training,  the  shooters  are  unable 
to  perform  training  or  maintain  proficiency  in  launch  operations. 

Other  factors  also  impact  the  quality  of  Eaunch  Officer  Training  (EOT)  while  underway. 
Training  opportunities  are  subject  to  scheduling  conflicts  since  the  training  requirements 
of  shipboard  personnel  and  aircrew  are  prioritized  to  maximize  the  training  opportunities 
which  will  certify  the  battlegroup,  consisting  of  the  CVN,  embarked  airwing  and  escort 
ships  for  deployment.  During  the  Composite  Training  Unit  Exercise  (COMPTUEX)  the 
CVN  /Airwing  team  are  evaluated  to  determine  if  they  receive  their  blue  water  certification 
which  allows  them  to  conduct  flight  operations  outside  the  range  of  a  land  based  emergency 
landing  field.  One  area  in  which  they  are  evaluated  as  part  of  the  blue  water  certification 
process  involves  timing  every  launch  and  recovery  cycle  from  the  first  launch  to  the  last 
recovery  over  the  span  of  a  designated  24-hour  continuous  operations  period.  If  that  total 
time  is  not  within  the  acceptable  limits,  the  blue  water  certification  is  not  awarded.  Blue 
water  certification  is  required  prior  to  deployment,  so  during  this  phase  of  the  exercise  no 
flight  deck  training  is  conducted  and  only  fully  qualified  personnel  are  performing  flight 
deck  operations  in  order  to  ensure  that  the  battlegroup  achieves  certification.  Other  ship¬ 
board  training  conducted  for  pre-deployment  requirements  include  shipboard  emergency 
procedures,  fire  drills,  reactor  drills,  deckedge  training,  and  topside  petty  officer  training. 
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Additionally,  the  OJT  approach  to  LOT  offers  exposure  to  a  limited  subset  of  the  scenar¬ 
ios  that  a  trainee  can  expect  to  encounter  while  deployed.  When  launching  aircraft  from 
a  CVN,  there  are  numerous  abnormal  situations  that  have  a  high  potential  for  catastrophic 
consequences  if  not  handled  correctly.  Consequently,  LOT  in  the  current  form  is  conducted 
when  the  opportunity  arises  and  the  scenarios  experienced  by  trainees  are  routine  in  nature 
except  under  rare  circumstances. 


2.2  Training  Requirements 

In  order  for  an  officer  to  become  fully  qualified  as  a  shooter  he  must  complete  the  Aircraft 
Launch  and  Recovery  Equipment  Officer  course  at  Center  for  Naval  Aviation  Technical 
Training  (CNATT)  detachment  Lakehurst,  NJ.  Upon  completion  of  this  training  course, 
the  officer  then  reports  to  their  aircraft  carrier  to  begin  the  launch  and  recovery  officer 
PQS.  The  PQS  is  used  to  record  the  completion  of  training  on  four  watchstations:  arresting 
gear  officer  (AGO),  no-load  operations  officer,  bow  launch  officer,  and  waist  launch  officer 
[2].  The  commanding  officer’s  representative,  usually  the  air  boss,  signs  the  PQS  granting 
qualification  in  each  of  these  areas  upon  completion  of  the  appropriate  section  of  the  PQS. 
The  following  are  the  estimated  completion  times  for  the  various  qualifications: 

•  AGO  :  Four  weeks  of  flight  operations 

•  no-load  operations  officer  :  two  weeks 

•  bow  launch  officer  :  six  weeks  of  flight  operations 

•  waist  launch  officer  :  six  weeks  of  flight  operations  [2] 

Training  for  each  of  these  watchstations  must  be  conducted  during  flight  operations.  As 
previously  discussed,  this  limitation  means  that  training  cannot  be  conducted  while  the 
CVN  is  in  port  or  while  underway  performing  non-flight  operations.  The  only  qualifica¬ 
tion  that  does  not  require  flight  operations  is  the  no-load  operations  officer.  However,  even 
though  it  does  not  require  flight  operations,  it  does  require  that  steam  is  provided  to  the 
catapults.  When  the  CVN  is  in  port,  catapults  are  rarely  provided  with  steam,  so  no-load 
operations  are  normally  conducted  while  the  CVN  is  underway.  Ultimately,  the  only  op¬ 
portunity  for  a  shooter  to  complete  the  requisite  PQS  is  when  a  CVN  is  underway  and 
conducting  flight  operations. 
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2.3  Launch  Procedures 

The  procedures  of  launching  an  aircraft  from  the  flight  deck  of  a  CVN  are  described  in 
detail  in  the  Naval  Air  Training  and  Operating  Procedures  Standardization  (NATOPS)  [1]. 
The  two  methods  in  which  aircraft  are  launched  are  from  the  deck,  known  as  a  “topside” 
launch  (Figure  2.1),  and  from  the  Integrated  Catapult  Control  Station  (ICCS),  known  as 
a  “bubble”  launch  (Figure  2.2.)  During  a  topside  launch,  the  shooter  is  standing  on  the 
flight  deck  and  directs  the  deckedge  operator,  via  hand  signals,  to  press  the  buttons  which 
operate  the  catapult.  In  this  type  of  launch,  the  shooter  has  direct  interaction  with  the  events 
on  the  flight  deck,  but  limited  control  over  the  actual  catapult  operation.  During  a  bubble 
launch,  the  shooter  presses  the  catapult  buttons  himself  but  has  limited  interaction  with  the 
flight  deck  and  must  communicate  his  intentions  via  radio  and  a  safety  observer.  With  the 
exception  of  who  is  pressing  the  buttons,  there  is  no  difference  in  the  launch  procedure. 
The  narrative  of  these  procedures  for  launching  an  aircraft  from  the  bow  catapults  is  as 
follows: 


Figure  2.1:  Topside  launch  from  USS  George  H.W.  Bush  (CVN-77)  with  shooter  under  instruc¬ 
tion,  from  CVN-77  homepage  [3] 

The  bow  launch  begins  when  the  flight  director  signals  the  aircraft  to  be  put  into  tension. 
He  then  passes  control  of  the  aircraft  to  the  shooter.  From  this  point  on,  if  the  shooter 
identifies  anything  out  of  the  ordinary,  he  will  signal  to  the  deckedge  operator  to  suspend 
the  catapult.  If  no  unusual  situations  present  themselves,  the  shooter  gives  the  military 
power  signal  to  the  pilot  indicating  that  the  aircraft  engines  should  be  put  into  the  launching 
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Figure  2.2:  ICCS  on  USS  Ronald  Reagan  (CVN-76)  from  [4] 


throttle  position.  Once  the  pilot  completes  his  launch  checks  and  is  ready,  he  salutes  the 
shooter.  The  shooter  returns  his  salute  and  signals  the  deckedge  operator  to  put  the  catapult 
into  the  final  ready  condition  by  raising  his  forward  arm  above  his  head.  The  shooter  then 
conducts  the  launch  scan  as  described  above.  Upon  completion  of  the  scan,  the  shooter 
touches  the  deck,  and  with  deck  pitch  and  interval  timing  under  consideration  raises  his 
finger  off  the  deck  pointing  towards  the  bow  of  the  ship  signaling  the  deckedge  operator  to 
fire  the  catapult.  The  aircraft  launches  and  the  process  is  repeated  for  the  next  aircraft. 

If  the  aircraft  does  not  launch  even  though  the  fire  button  was  pressed,  this  is  known  as  a 
hangfire  condition  and  is  indicated  by  the  red  fire  light  being  illuminated,  with  no  suspend 
light  and  the  aircraft  not  launching.  In  this  condition  the  catapult  could  fire  at  any  time. 
This  is  an  emergency  and  the  shooter  must  follow  the  appropriate  procedures.  The  actions 
taken  by  the  shooter  in  the  event  of  a  hangfire  are: 

•  Shooter  gives  the  hand  signal  for  suspend,  which  directs  the  deck  edge  operator  to 
electronically  safe  the  catapult 

•  Shooter  then  gives  the  hangfire  hand  signal  to  the  deckedge  operator 

•  The  deckedge  operator  calls  down  to  the  catapult  control  room  via  sound  powered 
phones  and  waits  for  confirmation  that  the  catapult  has  been  placed  in  a  safe  condition 
mechanically 

•  The  deckedge  gives  the  hand  signal  to  the  shooter  indicating  that  the  cat  is  safe 

•  The  shooter  then  stands  up  and  gives  the  pilot  the  throttle  back  hand  signal  directing 
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him  to  put  the  aircraft  engines  into  an  idle  state 
•  The  aircraft  is  then  removed  from  tension 

An  unqualified  shooter  is  required  to  perform  launch  procedures  a  minimum  of  48  times 
under  various  conditions  as  outlined  in  the  PQS  [2]  in  order  to  become  fully  qualified. 

2.4  Current  Training 

The  requirement  for  a  CVN  to  be  underway,  conducting  flight  operations,  in  order  to  con¬ 
duct  shooter  training  forces  aircraft  carriers  that  are  in  port  or  in  the  shipyard  to  take  it 
upon  themselves  to  find  training  opportunities  for  their  shooters.  They  must  coordinate 
with  other  aircraft  carriers  that  are  underway  as  part  of  their  pre-deployment  training  cycle 
during  phases  requiring  flight  operations  to  train  their  own  shooters.  This  situation  has 
numerous  challenges  and  is  undesirable  for  several  reasons. 

First,  the  officers  are  being  trained  on  a  ship  that  may  have  different  Standard  Operating 
Procedures  (SOP)  and  possibly  a  different  configuration  than  the  one  to  which  they  are 
assigned.  For  example,  the  USS  Harry  S.  Truman  (CVN-75)  has  four  arresting  gear  engines 
and  the  outer  panel  of  catapult  number  two  Jet  Blast  Deflector  (JBD)  fouls  (obstructs)  the 
landing  area.  The  USS  Ronald  Reagan  (CVN-76)  only  has  three  arresting  gear  engines  and 
catapult  number  two’s  JBD  does  not  foul  the  landing  area.  A  shooter  from  the  USS  Harry 
S.  Truman  training  on  the  USS  Ronald  Reagan  will  have  been  trained  with  procedures  that 
could  lead  to  dangerous  situations,  such  as  declaring  the  landing  area  clear  when  the  outer 
panel  of  catapult  two’s  JBD  is  raised. 

Next,  it  is  a  burden  on  the  hosting  command  to  train  visiting  officers.  While  being  evaluated 
as  part  of  a  pre-deployment  exercise,  a  command  is  under  a  great  deal  of  pressure.  Not  only 
are  they  being  evaluated  on  their  effectiveness  as  a  unit,  but  also  on  their  training  programs 
and  personnel  levels.  Therefore,  the  hosting  command  will  give  higher  training  priority  to 
their  own  personnel,  specifically  their  shooters,  enlisted  monitors,  and  deckedge  operators. 
If  the  monitor  or  deckedge  operator  is  training,  the  visiting  shooter  will  be  unable  to  train 
due  to  the  following  NATOPS  restriction  “catapult  shall  not  be  operated  when  the  launching 
officer  and  the  monitor  /  deckedge  operator  are  under  instruction  at  the  same  time”  [1]. 

Finally,  most  shooters  are  naval  aviators  and  naval  flight  officers  on  a  disassociated  sea  tour. 
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after  having  recently  completed  a  flying  tour.  They  come  from  various  aircraft  platforms 
but  all  share  the  background  of  flight  school  and  flight  training,  where  the  importance  of 
training,  and  practice  was  emphasized.  Naval  aviators  and  naval  flight  officers  conduct  a 
large  portion  of  their  training  and  qualification  in  simulators  and  are  familiar  with  learning 
new  skills  in  simulation  prior  to  practicing  and  demonstrating  those  skills  in  an  operational 
environment.  This  allows  for  decreased  time  to  train  and  lower  cost.  In  order  to  train  a 
shooter  in  as  close  as  possible  to  the  PQS  estimated  time  to  train  of  18  weeks  [2],  commands 
maximize  training  opportunities  by  sending  officers  underway  on  any  available  carrier, 
which  increases  the  burden  on  the  officer  under  training  by  requiring  them  to  spend  weeks 
away  from  their  command,  and  additional  time  away  from  their  families  in  order  to  conduct 
training  while  their  own  ship  is  in  port.  This  time,  cost,  and  burden  could  be  reduced  if  the 
officer  was  able  to  conduct  training  in  a  simulator,  just  as  he  would  in  a  flying  command. 
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CHAPTER  3: 
Literature  Review 


This  chapter  explores  research  in  the  areas  of  skill  acquisition,  job  task  analysis,  and  virtual 
environments.  The  work  discussed  in  this  chapter  forms  the  academic  justification  for  the 
creation  of  the  virtual  shooter  environment. 

3.1  Skill  Acquisition 

Based  on  decades  of  research,  Dreyfus  and  Dreyfus  [5]-[7]  developed  a  model  consisting 
of  five  skill  levels  founded  upon  four  mental  qualities  that  an  individual  must  pass  through 
when  learning  a  skill  as  shown  in  Table  3.1.  These  skill  levels  are:  novice,  advanced 
beginner,  competence,  proficiency,  expertise.  Within  each  skill  level  the  mental  functions 
required  are  components,  perspective,  decision,  and  commitment.  The  levels  are  described 
as  such: 

•  Novice:  A  beginner  who  is  given  context  free  task  features  and  a  set  of  rules  for 
determining  actions  to  be  taken  based  on  the  features. 

•  Advanced  beginner:  As  the  novice  gains  experience  in  actual  situations,  they  develop 
an  understanding  of  the  context  of  the  situation  and  begin  to  notice  additional  aspects 
based  on  this  experience  in  combination  with  the  non-contextual  features  previously 
learned. 

•  Competence:  Increased  practice  has  exposed  the  individual  to  more  situational  com¬ 
ponents  and  he  can  now  recognize  whole  situations,  which  have  meaning  and  rele¬ 
vance  to  the  achievement  of  a  long-term  goal.  The  learner  is  able  to  prioritize  the 
overwhelming  number  of  potentially  important  situational  aspects  into  those  that  are 
currently  relevant  and  those  that  can  be  safely  ignored  and  develop  new  rules  that  are 
based  on  their  own  experience. 

•  Proficiency:  Upon  reaching  this  stage,  an  individual  becomes  emotionally  involved 
in  the  task  and  achieves  intuition  to  discriminate  between  various  situations  and 
choose  the  appropriate  action.  Once  this  action  is  decided  he  falls  back  on  the  rule- 
based  decisions  to  achieve  the  goal. 

•  Expertise:  The  individual’s  vast  experience  not  only  allows  him  to  intuitively  dis- 
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criminate  between  situations  but  also  immediately  know  the  actions  that  need  to  be 
taken  in  order  to  achieve  his  goal.  This  ability  to  make  more  subtle  discriminations 
is  what  distinguishes  expert  from  proficient  performers. 


Table  3.1:  Five  Stages  of  Skill  Acquisition,  from  Dreyfus  and  Dreyfus  [7] 


SkiU  Level 

Components 

Perspective 

Decision 

Commitment 

1 .  Novice 

Context  free 

None 

Analytic 

Detached 

2.  Advanced  beginner 

Context  free  and  situational 

None 

Analytic 

Detached 

3.  Compelenl 

Context  free  and  situational 

Chosen 

Analytic 

Detached  understanding  and  deciding: 
involved  outcome 

4.  Proficient 

Context  free  and  situational 

Experienced 

Analytic 

Involved  understanding:  detached 
deciding 

5.  Expert 

Context  free  and  situational 

Experienced 

Intuitive 

Involved 

NoLe:  Components:  This  refers  to  the  elements  of  the  situation  that  the  learner  is  able  to  perceive.  These  can  be  context  free  and  pertaining 
to  general  aspects  of  the  skill  or  situational,  which  only  relate  to  the  specific  situation  that  the  learner  is  meeting.  Perspective:  As  the  learner 
begins  to  be  able  to  recognize  almost  innumerable  components,  he  or  she  must  choose  which  one  to  focus  on.  He  or  she  is  then  taking  a  per¬ 
spective.  Decision:  The  learner  is  making  a  tlecision  on  how  to  act  in  the  situation  he  or  she  is  in.  Th  is  can  be  based  on  analytic  reasoning  or  an 
intuitive  decision  based  on  experience  and  holistic  discrimination  of  the  particular  situation.  Commitment:  This  describes  the  degree  to 
which  the  learrter  is  immersed  in  the  learning  situation  when  it  comes  to  uttderslanding.  deciding,  and  the  outcome  of  the  situation — action 
pairing. 


Dreyfus  and  Dreyfus  [5]  stress  that  it  is  essential,  when  developing  a  training  program,  to 
determine  the  skill  level  that  the  trainee  has  aehieved  in  order  to  be  effeetive.  If  the  training 
program  is  not  at  the  appropriate  level,  the  trainee  will  not  progress  to  the  next  stage  and 
may  even  regress  to  a  previous  level.  For  example,  qualified  offieers  undergoing  training 
who  have  already  eompleted  sehoolhouse  shooter  training,  arresting  gear  offieer  qualifi- 
eation,  and  no-loads  operator  training  from  the  shooter  PQS,  would  be  assessed  to  be  at 
the  “advaneed  beginner”  skill  level.  These  offieers  are  able  to  reeognize  various  situations 
and  mentally  determine  the  eorreet  aetions  to  take,  however,  they  have  little  to  no  aetual 
praetice.  They  lack  the  rehearsed  motor  skills  required  to  carry  out  a  prescribed  action  and 
may  not  recognize  unusual  circumstances.  According  to  the  Dreyfus  and  Dreyfus  model, 
this  recognition  will  come  with  experience,  practice,  and  exposure  to  varying  situations. 

It  is  relevant  to  note  that  Gobet  and  Chassy  [8]  criticize  the  Dreyfus  and  Dreyfus  model. 
In  particular,  they  disagree  with  the  description  of  distinct  phases  and  the  attributes  of 
expertise  relying  purely  on  intuition.  Despite  these  criticisms,  the  Dreyfus  and  Dreyfus 
model  is  applicable  to  training  situations  in  which  the  trainee  is  at  the  advanced  beginner  / 
competent  levels  as  the  individual  in  these  stages  still  relies  on  decision  making  and  rules 
instead  of  the  intuition  described  at  the  expert  level  [8], 
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In  1988,  Baldwin  and  Ford  [9]  reviewed  the  research  on  training  effectiveness,  specifically 
the  transfer  of  training,  defined  as  “the  degree  to  which  trainees  effectively  apply  the  knowl¬ 
edge,  skills,  and  attitudes  gained  in  a  training  context  to  the  job”  [10].  This  model  identifies 
the  interaction  between  training  inputs,  training  outputs  and  conditions  of  transfer.  Training 
inputs  are  trainee  characteristics,  training  design,  and  work  environment.  Trainee  charac¬ 
teristics  include  ability,  personality,  and  motivation.  Training  design  includes  principles 
of  learning,  sequencing,  and  training  content.  Work  environment  includes  support  and  op¬ 
portunity  to  use  learned  behaviors  on  the  job.  The  research  conducted  by  Baldwin  and 
Ford  reinforces  this  thesis’  hypothesis  that  skills  learned  in  a  training  environment  can  be 
transferred  to  the  job. 

3.1.1  Training  Fidelity 

Baldwin  and  Ford  note  that  a  large  portion  of  previous  research  focused  on  four  basic  prin¬ 
ciples,  identical  elements,  teaching  of  general  principles,  stimulus  variability,  and  various 
conditions  of  practice  [9].  The  principles  of  identical  elements  and  stimulus  variability 
are  of  particular  importance  for  this  thesis.  The  principle  of  identical  elements  consists  of 
two  aspects,  physical  fidelity  and  psychological  fidelity.  Physical  fidelity  is  defined  as  “the 
degree  to  which  the  physical  simulation  looks,  sounds,  and  feels  like  the  operational  envi¬ 
ronment  in  terms  of  the  visual  displays,  controls,  and  audio  as  well  as  the  physics  models 
driving  each  of  these  variables”  [11].  Psychological  fidelity  is  defined  as  “the  degree  to 
which  the  simulation  replicates  the  psychological  factors  (i.e.,  stress,  fear)  experienced  in 
the  real-world  environment,  engaging  the  trainee  in  the  same  manner  as  the  actual  equip¬ 
ment  would  in  the  real  world”  [11]. 

Stimulus  variability  is  based  on  the  notion  that  training  is  maximized  when  there  is  a  vari¬ 
ety  of  relevant  training  stimuli  [9].  Shore  and  Sechrest  [12]  found  that  using  a  number  of 
examples  repeated  a  few  times  was  more  effective  than  using  one  example  repeated  many 
times.  For  example,  a  small  number  of  launch  scenarios,  such  as  a  normal  launch,  a  sus¬ 
pend,  and  a  wind  out  of  limits  event,  changing  throughout  a  few  training  sessions  would  be 
more  effective  than  the  exact  same  scenario,  such  as  a  normal  launch,  repeated  over  many 
training  sessions. 

Several  investigations  [13]-[16]  demonstrate  that  the  highest  levels  of  positive  training 
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transfer,  defined  “as  the  degree  to  which  trainees  effectively  apply  the  knowledge,  skills, 
and  attitudes  gained  in  a  training  context  to  the  job”  [9],  is  not  based  on  fidelity,  but  rather 
the  capacity  of  one  part  of  the  stimulus  to  cue  the  entire  scenario.  These  findings  are  also 
supported  by  Alexander  et  ah,  who  found  that  although  the  relationship  between  fidelity 
and  transfer  is  complex,  if  the  level  of  fidelity  captures  the  critical  elements  of  the  task  or 
skill  that  is  desired  to  be  taught,  then  the  level  of  fidelity  is  sufficient  even  if  the  level  of 
fidelity  differs  significantly  from  the  real  world  [11].  This  means  that  the  required  fidelity 
changes  based  on  the  type  of  training.  These  investigations  show  that  even  low  fidelity 
training  aids  are  effective  in  producing  high  quality  training  as  long  as  there  are  strong  and 
accurate  cuing  relationships  between  the  scenario  attributes  and  appropriate  actions. 

3.1.2  Presence  and  Immersion 

Computer  based  alternatives  to  live  training  such  as  simulators,  computer  based  training 
and  even  video  games  are  becoming  more  common  [10].  Alexander  et  al.  [11]  propose  that 
knowledge  transfer  can  be  increased  by  manipulating  four  key  concepts  of  the  environment 
represented  by  the  computer  based  system:  fidelity,  immersion,  presence  and  buy-in.  As 
previously  discussed,  fidelity  consists  of  physical  and  psychological  types. 

Immersion  refers  to  the  degree  to  which  an  individual  feels  absorbed  by  or  engrossed  in 
a  particular  experience  [17].  Many  activities  can  be  immersive,  such  as  reading  a  book, 
playing  chess,  or  watching  a  movie. 

Presence  refers  to  the  experience  of  actually  existing  within  the  virtual  environment  [17], 
[18].  The  difference  between  immersion  and  presence  is  the  sense  of  physicality.  When 
immersed  in  an  activity  a  user  remains  aware  of  their  physical  location.  When  they  have 
the  sensation  of  presence  in  a  virtual  environment  they  experience  the  sensation  that  they 
are  physically  located  in  that  environment. 

Buy-in  refers  to  the  degree  to  which  a  person  believes  that  an  experience  is  useful  to  their 
training  [11].  The  concept  of  buy-in  in  this  context  is  that  the  more  useful  a  trainee  feels 
the  training  environment  is,  the  more  effort  they  will  put  into  learning  within  that  environ¬ 
ment.  Likewise,  if  they  feel  that  a  training  environment  is  not  effective  they  will  stop  using 
that  training  device.  Alexander  et  al.  note  that  there  is  anecdotal,  but  not  empirical,  evi¬ 
dence  that  buy-in  will  affect  transfer  from  simulation  to  operation  if  the  amount  of  training 
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remains  constant  [11]. 


Bacon  and  MacKinnon  [19]  showed  that  in  order  to  build  an  effective  virtual  environment 
(in  this  case  a  serious  game)  the  intended  learning  content  must  be  fully  embedded  into 
the  gameplay,  and  the  environment  must  be  immersive  and  engaging.  Their  study  built 
on  the  work  of  others  who  demonstrated  that  with  full  immersion  and  engagement  in  the 
virtual  environment,  the  subjects  experienced  positive  transfer  of  training  from  the  virtual 
environment  to  the  real  world. 


3.2  Job  Task  Analysis 

In  a  June  2012  Government  Accountability  Office  briefing  for  the  Senate  and  House  Armed 
Services  Committees  [20],  it  was  stated  that  “If  a  skill  or  talent  can  be  developed  or  refined, 
or  if  a  proficiency  can  be  effectively  and  efficiently  maintained  in  a  simulator,  then  these 
skills/talents/proficiencies  should  be  developed/refined/maintained  in  a  simulator”.  Before 
a  simulator  can  be  developed  to  effectively  answer  the  GAO’s  directive,  the  task  to  be 
trained  must  be  thoroughly  understood. 

Naval  education  and  training  command  has  a  manual  entitled  Job  Duty  Task  Analysis 
(JDTA)  Management  Manual  [21]  which  describes  a  process  for  analyzing  the  compo¬ 
nents  required  in  order  to  accomplish  an  objective.  Within  this  manual  are  the  following 
definitions: 

•  An  occupation  is  a  family  of  jobs  that  share  a  common  set  of  skills.  In  the  Navy,  an 
occupation  is  associated  with  a  rating  and  is  comprised  of  one  or  more  jobs 

•  A  job  is  composed  of  the  duties,  tasks,  and  steps  performed  by  an  individual.  A  job 
is  comprised  of  one  or  more  duties 

•  A  duty  is  a  set  of  related  tasks  within  a  job.  A  duty  is  comprised  of  one  or  more  tasks, 
and  occurs  frequently 

•  A  task  is  a  single  unit  of  specific  work  behavior  with  clear  beginning  and  ending 
points 

•  A  sub-task  is  a  major  part  of  a  task  and  is  made  up  of  one  or  more  steps 

•  A  step  is  the  smallest  component  in  the  process 

By  these  definitions,  launch  officer  is  an  occupation  composed  of  various  jobs  which  are 
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outlined  in  the  PQS.  Following  the  JDTA  process,  jobs  are  broken  down  into  tasks  and 
steps.  Specific  skills  are  required  in  order  to  complete  the  various  steps.  Further,  each  skill 
can  have  one,  all,  or  a  mix  of  the  following: 

•  Declarative  Knowledge  (DK),  factual  or  experimental  [22] 

•  Procedural  Knowledge  (PK),  goal  oriented  and  mediates  problem  solving  [22] 

•  Situational  Awareness  (SA),  what  is  happening  in  the  vicinity  [23] 

In  the  case  of  this  thesis,  declarative  knowledge  is  the  academic  knowledge  of  the  physical 
systems  known  as  Aircraft  Launch  and  Recovery  Equipment  (ALRE).  The  PQS  lists  com¬ 
pletion  of  Shooter  School  as  a  prerequisite  for  every  watchstander  qualification.  Shooter 
School  consists  of  a  formal  systems  training  course  where  the  officers  are  taught  the  cata¬ 
pult  and  arresting  gear  systems.  In  addition  to  shooter  school  the  PQS  also  requires  that  the 
officer  understand  the  operation  of  the  systems  prior  to  qualification.  This  academic  knowl¬ 
edge  of  system  operations  ensures  that  the  launch  officer  understands  what  is  happening  to 
the  equipment  and  it  ensures  that  he  can  enforce  the  execution  of  proper  procedures. 

Procedural  knowledge  is  the  memorization  and  understanding  of  the  procedures  outlined  in 
the  PQS,  SOPs  and  governing  instructions,  and  is  represented  by  the  ability  of  a  qualified 
shooter  to  recognize  abnormal  conditions  immediately  and  carry  out  the  proper  procedures 
at  all  times.  Procedural  knowledge  is  directly  impacted  by  experience.  An  experienced 
shooter  can  recognize  the  first  indication  that  an  abnormal  procedure  is  developing  and 
then  take  the  appropriate  action  to  either  mitigate  or  prevent  that  situation  from  developing 
further.  Eor  example,  they  might  notice  that  as  an  aircraft  is  approaching  the  catapult  some¬ 
thing  does  not  look  the  way  that  it  has  looked  on  similar  aircraft  based  on  their  experience. 
The  shooter  can  bring  this  to  the  attention  of  the  final  checker  to  determine  if  the  aircraft 
is  properly  configured.  The  shooter  can  then  proceed  to  launch  or  turn  it  away  prior  to 
pre-launch  checks  on  the  catapult. 

Situational  awareness  is  understanding  what  is  happening  around  you,  and  being  aware 
of  how  the  situation  is  progressing  based  on  your  knowledge  and  experience.  Eor  this 
thesis,  the  definition  used  for  Situational  Awareness  is  provided  by  Mica  Endsley  as  “the 
perception  of  the  elements  in  the  environment  within  a  volume  of  time  and  space,  the 
comprehension  of  their  meaning  and  the  projection  of  their  status  into  the  near  future”  [23]. 
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Endsley  describes  three  levels  of  situational  awareness.  Level  one  is  the  perception  of 
elements  in  the  current  situation.  Level  two  is  the  comprehension  of  the  current  situation. 
Level  three  is  the  projection  of  future  status.  As  one  progresses  through  the  skill  levels 
described  by  Dreyfus  and  Dreyfus,  they  should  also  move  along  the  situational  awareness 
levels  described  by  Endsley. 

One  aspect  of  SA  as  it  pertains  to  this  thesis  is  visual  observation.  Visual  observation  is 
defined  as  the  shooter  physically  looking  at  various  areas  of  the  flight  deck.  He  is  visually 
verifying  that  the  ALRE  equipment  is  in  the  proper  operating  condition,  the  expected  type 
of  aircraft  is  in  the  landing  pattern,  the  aircraft  approaching  the  catapult  is  in  the  correct 
configuration,  and  the  personnel  on  the  flight  deck  are  in  the  proper  positions.  The  amount 
of  information  recognized  as  the  shooter  is  observing  the  areas  of  the  flight  deck  will  change 
as  they  increase  through  the  levels  of  SA.  Lor  example,  a  shooter  with  level  one  SA  will 
observe  that  there  is  a  person  standing  outside  the  safe-shot  line  and  continue  with  the 
launch  because  no  rules  are  being  violated.  The  shooter  with  level  two  SA  will  recognize 
that  the  person  in  question  is  part  of  the  safety  officer  tour.  Linally,  the  shooter  with  level 
three  SA  will  recognize  that  this  person  is  not  only  part  of  the  tour,  but  also  separated  from 
the  rest  of  their  group  and  will  most  likely  cross  the  safe  shot  line  in  the  near  future  in  order 
to  get  back  to  their  friends. 

3.3  Virtual  Environments 

According  to  Ellis,  virtual  environments  can  be  defined  as  “interactive,  virtual  image  dis¬ 
plays  enhanced  by  special  processing  and  by  non-visual  display  modalities,  such  as  audi¬ 
tory  and  haptic,  to  convince  users  that  they  are  immersed  in  a  synthetic  space.”  [24].  There 
are  many  methods  of  using  computers  to  simulate  environments,  of  particular  interest  to 
training  simulation  are  Virtual  Reality  (VR),  AR,  and  Mixed  Reality  (MR).  Virtual  Reality 
completely  immerses  a  user  inside  computer  generated  3D  environment.  While  in  this  en¬ 
vironment  the  user  cannot  see  the  real  world  [25].  Augmented  Reality  provides  computer 
generated  objects  and  information  overlaid  onto  the  user’s  view  of  the  real  world  [25],  [26]. 
Mixed  Reality  is  the  varying  mix  of  real  and  virtual  elements  as  shown  in  Ligure  3. 1  [27].  If 
one  were  to  take  the  spectrum  of  reality  from  completely  virtual  on  one  end  to  completely 
real  on  the  other,  it  would  be  called  the  mixed  reality  continuum  [26]  and  in  it  AR  lies  in 
between  the  two  extremes  [28].  Essentially,  VR  replaces  the  real  world  where  AR  enhances 
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Figure  3.1:  The  mixed  reality  continuum,  from  Milgram  [27] 


3.3.1  Virtual  Reality 

Virtual  reality  is  a  popular  training  technology.  The  types  of  VR  systems  used  are  projec¬ 
tion  systems  such  as  the  Cave  Automatic  Virtual  Environment  (CAVE)  system  which  uses 
stereo  surround  sound  and  projected  3D  computer  images  onto  screens  that  completely 
surround  the  user  [29],  full  simulator  systems  which  reproduce  a  vehicle  and  then  project 
or  display  the  environment  on  screens  or  monitors,  and  immersive  head  mounted  display 
systems  where  the  entire  environment  is  presented  via  a  device  worn  on  the  head  of  the 
user. 

Applications  of  VR 

Military  simulators  are  an  example  of  practical  application  of  VR.  They  place  the  user  into 
an  entirely  computer-generated  environment.  The  user  interacts  with  the  environment  from 
within  a  physical  reproduction  of  the  vehicle  they  will  be  operating  (aircraft,  tank.  High 
Mobility  Multipurpose  Wheeled  Vehicle  (HMMWV),  etc.)  A  completely  virtual  environ¬ 
ment  is  projected  on  screens  outside  the  vehicle  and  inputs  are  sent  to  the  systems  inside 
the  vehicle  [30],  [31].  However,  there  are  other  types  of  VR  that  are  also  employed,  such 
as  the  Eanding  Signal  Officer  (ESO)  trainer  at  the  ESO  School  in  Virginia  Beach  [32].  This 
trainer  uses  a  CAVE  display  system  with  a  simulator  type  platform  to  train  landing  signal 
officers  in  directing  aircraft  to  land  on  the  deck  of  an  aircraft  carrier.  Additionally,  head 
mounted  displays  have  been  used  to  train  individuals  for  specific  dangerous  tasks  such  as 
parachute  jumping  [33],  where  the  trainee  can  practice  parachuting  skills  prior  to  an  actual 
jump,  and  for  small  unit  infantry  training  such  as  the  Euture  Immersive  Training  Environ¬ 
ment  (EITE),  system  where  a  soldier  can  train  his  infantry  skills. 
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3.3.2  Augmented  Reality 


Types 

Azuma  [25]  defines  AR  as  any  system  that  has  the  following  three  eharaeteristies: 

1.  Combines  real  and  virtual 

2.  Is  interaetive  in  real  time 

3.  Is  registered  in  three  dimensions 

By  this  definition  AR  is  not  limited  to  any  particular  type  of  technology.  Currently,  AR 
is  being  used  on  many  different  platforms.  These  include  smart  phones,  head  mounted 
displays,  desktop  and  laptop  computers,  and  specialized  technology  such  as  amusement 
park  rides  [34].  Despite  the  differing  platforms,  AR  is  classified  into  three  broad  areas: 
headworn,  handheld,  and  projected  [28]. 

Headworn  displays  are  devices  worn  on  the  head  which  present  content  directly  in  front 
of  the  user’s  eyes  and  can  be  divided  into  two  main  types:  optical  see-through,  and  video 
see-through.  In  optical  see-through  the  user  is  looking  through  a  transparent  medium  with 
the  virtual  images  displayed  via  some  form  of  technology  such  as  a  waveform,  prisms,  or 
transparent  light  field  matrix  [25],  [28],  [34]-[40].  In  video  see-through,  the  user  is  looking 
at  the  real  world  as  captured  by  cameras  with  the  virtual  objects  integrated  into  the  scene 
and  displayed  on  opaque  screens  in  front  of  their  eyes. 

Handheld  displays  use  a  Liquid  Crystal  Display  (LCD)  or  Organic  Light-Emitting  Diode 
(OLED)  screen  such  as  those  found  on  a  smart  phone  or  tablet  with  an  attached  camera  to 
display  a  video  see  through  experience  to  the  user.  An  example  of  this  type  of  augmented 
reality  is  the  IKEA  augmented  reality  application  that  allows  a  potential  buyer  to  visualize 
how  furniture  from  the  IKEA  catalogue  would  look  in  their  own  home  (Eigure  3.2)  [41]. 

Projected  displays  use  projectors  to  present  virtual  information  into  the  area  around  the 
user.  One  example  of  the  use  of  this  type  of  display  is  the  immersive  environments  created 
in  the  Disney  themeparks  [42].  Eor  example  the  “Haunted  Mansion”  attraction  at  Disney 
World  for  which  virtual  ghosts  are  projected  into  the  ride  (Eigure  3.3.) 
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Figure  3.2:  IKEA  catalogue  AR  application,  from  Metaio  [41] 


Applications  of  AR 

The  number  of  eommereial  applieations  for  AR  is  inereasing  rapidly.  By  looking  on  the 
Apple  App  Store  or  Google  Play  marketplaee  there  are  a  large  number  of  AR  applieations 
for  smartphones  and  tablets  for  marketing,  advertisements  and  entertainment.  Disney  also 
employs  AR  for  entertainment  purposes  in  many  of  its  attraetions.  While  these  applieations 
are  interesting,  they  do  not  represent  the  full  potential  of  AR.  Metaio  has  provided  a  system 
to  Volkswagen  called  Marta  [43]  to  help  develop  the  XLl  concept  car  and  it  built  applica¬ 
tions  for  Mitsubishi  to  assist  their  sales  associates  by  allowing  them  to  show  customers 
what  their  heating  and  air  conditioning  units  would  look  like  in  the  customers  own  home. 
They  also  provide  AR  applications  to  the  manufacturing  industry  for  factory  layout,  pro¬ 
totyping,  and  training.  SCOPE  AR,  in  a  popular  training  demonstration,  uses  augmented 
reality  to  overlay  the  steps  of  a  repair  on  the  actual  piece  of  equipment  that  is  being  worked 
on  [44]  In  museums  such  as  the  Bavarian  National  Museum,  AR  enhances  the  exhibits. 
When  viewed  through  the  AR  application  on  a  visitor’s  smart  device,  details  of  interest, 
additional  views  of  the  piece  of  art,  or  overlays  of  the  original  setting  in  which  the  piece 
was  presented  historically  [45]  are  presented  to  the  viewer. 
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Figure  3.3:  Singing  bust  from  the  Haunted  Mansion  graveyard  without  (a)  and  with  (b)  AR, 
from  Mine  et  al.  [42] 


As  with  the  commercial  sector,  there  are  many  potential  military  applications  of  AR.  Mil¬ 
itary  aircraft  have  had  heads  up  displays  since  the  1960s  [46]  and  NASA  studied  using 
heads  up  displays  for  taxiway  navigation  [47]  and  many  other  applications.  Currently,  a 
projection-based  Mixed  Reality  system  is  installed  at  the  Infantry  Immersion  Trainer  in 
Camp  Pendleton,  a  binocular  AR  system  has  been  tested  for  use  in  forward  observer  train¬ 
ing  [48],  a  C-130  loadmaster  training  AR  application  was  developed  and  tested  [49],  and 
Applied  Research  Associates  recently  finished  testing  of  the  Ultra  Vis  AR  system  for  the 
dismounted  soldier  [50]-[52]. 


3.3.3  Mixed  Reality 

When  attempting  to  reproduce  experiments  with  AR  systems,  researchers  had  difficulty 
replicating  the  exact  conditions  encountered  during  the  original  experiments,  such  as  out¬ 
door  environmental  conditions  [53].  This  has  led  to  research  in  the  area  of  Mixed  Reality, 
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specifically,  the  work  of  Lee  et  al.  [53]-[56]  in  testing  various  AR  systems  inside  a  VR 
environment.  The  advantages  to  this  technique  include  a  controlled  environment  that  can 
be  reliably  reproduced,  and  the  ability  to  simulate  hardware  characteristics  of  different  AR 
devices  accurately  without  having  access  to  the  physical  equipment.  Lee  et  al.  showed 
that  testing  and  representation  of  AR  devices  in  VR  is  possible  by  successfully  recreating  a 
well-known  AR  experiment  originally  performed  by  Ellis.  In  this  experiment  virtual  rings 
were  manipulated  along  virtual  ropes  overlaid  on  the  real  world  via  a  head  mounted  dis¬ 
play.  Lee  and  his  team  created  a  virtual  world  with  a  virtual  hand  and  a  simulated  AR  view 
that  was  consistent  with  the  optical  see-through  device  used  in  the  original  experiment  and 
achieved  comparable  results. 

3.3.4  Current  Technology 

Current  technology  in  virtual  environments  consists  of  a  computational  platform  and  dis¬ 
plays.  The  desktop  computer  and  monitor  can  provide  a  virtual  environment  as  demon¬ 
strated  by  commercial  games  such  as  World  of  Warcraft  and  Second  Life.  This  type  of 
virtual  environment  could  be  both  low  cost  and  deployable.  Virtual  Reality  head  mounted 
displays  include  the  Oculus  Rift  which  is  attached  to  a  personal  computer  and  provides 
the  user  with  960x1080  display  for  each  eye  with  a  100  degree  field  of  view  [57].  The 
ZEISS  VR  One,  and  Google  Cardboard  provide  a  head  mount  to  hold  a  smart  phone  such 
as  the  iPhone  6  or  Samsung  Galaxy  S5  as  the  computational  and  display  platform  [58], 
[59].  The  lenses  in  the  mount  give  an  expanded  field  of  view  by  distorting  the  display,  but 
exact  numbers  vary  based  on  the  lenses  used.  The  range  is  anywhere  between  90-100  de¬ 
grees  based  on  various  technology  websites.  Handheld  AR  technology  primarily  consists 
of  smart  phones  with  cameras  running  either  iOS  or  Android  operating  systems  that  pro¬ 
vide  video  see-through  AR  experiences.  AR  head  mounted  displays  have  a  more  limited 
availability,  although  many  have  been  announced  one  of  the  few  available  is  the  EPSON 
Moverio  BT-200  which  provides  both  optical  and  video  see  through  capability  with  a  23 
degree  field  of  view  [60]. 

3.4  Chapter  Summary 

In  summary,  using  virtual  environments  to  achieve  training  transfer  which  results  in  the 
acquisition  of  skills  is  a  complex  combination  of  factors.  Analysis  of  the  desired  tasks  to 
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be  trained  and  skills  to  be  learned  are  essential  to  identifying  the  right  balance  of  these 
factors  in  the  development  of  a  training  environment.  The  hardware,  which  generates  the 
environment  will  also  impact  the  virtual  environment  based  on  the  methods  of  its  presen¬ 
tation.  When  determining  which  device  should  be  used,  practicalities  such  as  cost  and 
development  time  must  be  considered  and  can  have  a  considerable  impact  on  identifying 
the  correct  device. 

The  next  chapter  describes  the  methodology  used  to  determine  which  tasks  are  required  for 
the  shooters  to  perform  the  duties  of  the  various  watchstations,  the  approach  used  to  model 
these  tasks  in  a  manner  that  is  executable  on  current  computational  equipment,  and  which 
current  technologies  are  best  suited  to  realize  that  model. 
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CHAPTER  4: 

Methodology 


4.1  Job  Task  Analysis  Methodology 

The  JDTA  process  as  described  in  [21]  was  followed  to  deconstruct  the  launch  officer  job 
and  determine  the  relevant  tasks.  With  the  understanding  that  declarative  knowledge  is 
required  for  all  jobs,  an  assessment  was  made  to  determine  which  skills  and  sub-tasks 
were  required  for  each  watch  station  task  and  whether  these  skills  were  suitable  for  repre¬ 
sentation  in  a  virtual  environment,  defined  by  Ellis  as  “interactive,  virtual  image  displays 
enhanced  by  special  processing  and  by  non- visual  display  modalities,  such  as  auditory  and 
haptic,  to  convince  users  that  they  are  immersed  in  a  synthetic  space"  [24].  In  order  to  iden¬ 
tify  the  tasks  with  the  greatest  potential  advantage  for  training  and  proficiency  in  a  virtual 
environment,  each  task  was  examined  and  assigned  a  level  of  Difficulty,  Importance,  and 
Frequency  (DIF)  which  would  be  used  to  rank  the  tasks. 


4.2  Programming  Methodology 

An  evaluation  of  the  enablers  and  detractors  for  developing  a  virtual  environment  to  con¬ 
duct  these  tasks  was  performed  in  order  to  identify  the  difficulty  and  feasibility  of  creating 
an  appropriate  environment  using  a  top  down  programming  approach.  The  top  down  pro¬ 
gramming  approach  is  similar  to  the  job  task  analysis  in  that  the  problem  is  broken  into 
subsequently  smaller  items  until  each  of  these  items  can  be  performed  on  the  computa¬ 
tional  equipment  available. 


4.3  Analysis  of  Alternatives 

There  are  a  number  of  different  technologies  available  to  construct  a  virtual  environment. 
The  factors  considered  for  choosing  the  technology  used  included  hardware  and  software, 
cost,  portability,  and  ease  of  programming.  As  discussed  in  Chapter  3,  the  technology 
would  consist  of  a  computer  system,  a  software  package,  a  head-mounted  display  and  an 
input  device. 
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4.3.1  Hardware 

The  selection  of  low-cost  head-mounted  displays  is  limited,  and  the  analysis  focused 
mainly  on  cost  and  availability.  The  virtual  environment  could  be  useful  for  both  train¬ 
ing  and  proficiency.  In  order  to  accommodate  both  of  these  areas  the  hardware  required  for 
input  devices  was  evaluated  for  ease  of  use  for  both  instructors  and  users  of  the  systems 
while  minimizing  the  negative  impact  to  immersion  and  presence. 

4.3.2  Software 

Six  software  development  engines  were  considered  for  the  development  of  the  virtual  envi¬ 
ronment.  The  software  was  evaluated  based  on  operating  system  upon  which  it  ran,  whether 
it  has  built-in  Oculus  Rift  support,  cost  and  ease  of  use.  The  software  that  was  considered 
largely  fell  into  the  game  development  engine  categories  due  to  commercial  interest  in  uti¬ 
lizing  head  mounted  displays  in  game  development.  One  non-game  engine  virtual  reality 
software  package  was  evaluated  alongside  the  game  engines. 

4.4  Chapter  Summary 

This  chapter  discussed  the  methods  for  determining  the  tasks  required  in  the  performance 
of  the  shooter  duties,  how  these  tasks  were  analyzed  in  the  context  of  programming  them 
in  a  development  engine,  and  finally,  which  hardware  and  software  will  be  used  in  the 
development  of  the  virtual  environment.  The  next  chapter  presents  the  findings  of  this 
analysis  and  the  resulting  virtual  environment. 
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CHAPTER  5: 
Evaluation 


5.1  Job  Task  Analysis  Results 


The  results  of  the  job  task  analysis  are  presented  in  table  5.1  and  indicate  that  the  watch- 
station  with  the  potential  for  most  training  impact  is  the  Launch  Officer  watchstation.  The 
PQS  separates  the  Launch  Officer  qualification  into  two  distinct  qualifications,  bow  launch 
officer  and  waist  launch  officer.  Within  the  launch  officer  qualification,  the  most  important 
task  identified  in  Table  5.1  by  having  a  “high"  on  all  DIF  areas  was  the  scan  for  both  the 
bow  and  waist.  The  scan  patterns  for  bow  and  waist  launches  differ  slightly,  however,  both 
scans  consist  of  the  same  steps  with  the  primary  difference  being  where  the  items  within 
the  steps  are  physically  located  in  relation  to  the  shooter.  Thus,  the  task  analysis  evaluation 
found  the  bow  launch  scan  as  the  best-suited  scenario  for  representation  in  the  virtual  en¬ 
vironment.  Additional  tasks  in  the  watchstation  such  as  aircraft  configuration  and  aircraft 
hookup  and  alignment  can  be  added  to  the  scenario  for  additional  benefit. 

From  the  launch  procedures  and  JDTA,  the  following  steps  required  during  the  launch 
officer  scan  were  identified  as  essential  for  reproduction  in  the  virtual  environment: 

•  Visually  observe  bow  safety  light  is  green 

•  Visually  observe  deck  edge  has  hands  up  and  lights 

•  Visually  observe  three  white  catapult  status  lights  are  illuminated 

•  Visually  observe  that  the  suspend  light  is  not  illuminated 

•  Ensure  headwind  is  within  acceptable  limits 

•  Ensure  crosswind  is  within  acceptable  limits 

•  Visually  observe  the  landing  pattern  is  clear 

•  Visually  observe  the  status  of  the  other  launch  officer  to  determine  catapult  interval 

•  Visually  observe  the  aircraft  final  checker  giving  a  thumbs  up  signal 

•  Ensure  aircraft  pilots  head  is  steady 

•  Visually  observe  deck  pitch  and  signal  launch  according  to  SOP 
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Table  5.1:  Shooter  Job  Task  Analysis  Results 
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Figure  5.1:  Launch  Flow 
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The  bow  scan  tasks  were  further  broken  down  into  steps  which  are  represented  in  a 
flowchart  format  shown  in  Figure  5.1  Using  the  flowchart  and  task  analysis,  a  Finite  State 
Machine  (FSM)  was  developed  to  represent  the  flow  of  events  based  on  the  catapult  system 
status  (Figure  5.2)  This  FSM  was  the  model  for  the  development  of  the  virtual  environment. 


Figure  5.2:  Launch  Finite  State  Machine 


5.2  Development  of  the  Virtual  Environment 

Evidence  from  Chapter  3  supports  the  possibility  to  transfer  knowledge  and  training  skills 
from  a  virtual  environment  to  the  physical  world  if  the  virtual  world  has  adequate  immer¬ 
sion,  presence,  fidelity,  and  buy-in. 

The  main  elements  identified  for  programming  the  environment  during  the  programming 
methodology  described  in  Chapter  4  were: 

•  Input:  predefined  scenarios,  instructor  injects,  user  input 

•  Actions:  computations,  timing  events,  variable  manipulation 

•  Output:  environment  display,  reports,  timing  results 

These  elements  are  taken  into  consideration  when  evaluating  the  results  below  to  create  the 
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most  effective  virtual  environment. 


5.2.1  Hardware 

As  described  in  Chapter  2,  the  flight  deck  is  a  dynamic  environment  and  the  launch  officer 
is  scanning  the  area  while  simultaneously  using  both  of  his  hands  to  signal  others  on  the 
flight  deck.  A  video  see  through  system  such  as  one  generated  by  a  smartphone  or  tablet 
has  limited  utility  because  it  requires  the  use  of  at  least  one  hand  to  hold  the  display.  Hold¬ 
ing  a  screen  while  performing  dynamic  hand  signaling  would  likely  break  immersion  and 
presence.  Similarly,  head  mounted  AR  devices  do  not  provide  a  field  of  view  large  enough 
to  present  the  user  with  the  immersive  experience  necessary  for  a  dynamic  environment 
that  requires  constant  scanning.  Further,  head  mounted  AR  devices  suffer  from  tracking 
and  registration  issues,  limited  computational  power,  and  only  allow  for  a  single  person  to 
see  the  environment  at  a  time,  thus  limiting  the  instructor  input.  For  these  reasons  the  most 
promising  systems  for  which  to  develop  the  proposed  virtual  environment  are  the  desktop 
computer  environment  and  a  head  mounted  virtual  reality  system.  Both  systems  have  the 
computational  power  of  a  modem  desktop  computer  which  is  upgradeable  in  the  future. 
Both  systems  allow  for  the  instructor  to  observe  the  trainee  via  the  computer  monitor,  and 
inject  variables  if  desired.  The  head  mounted  system  provides  an  immersive  experience 
with  a  larger  field  of  view  and  without  the  tracking  and  registration  issues  that  could  im¬ 
pact  an  AR  system.  These  systems  are  also  both  low-cost  and  deployable. 

In  order  to  support  a  majority  of  computer  systems  available  to  the  fleet,  as  well  as  current 
head  mounted  displays  and  software  development  considerations,  the  hardware  required 
was  determined  to  be  a  modern  generation  desktop  or  laptop  computer.  The  hardware 
utilized  for  this  thesis  was  a  2012  Apple  Macbook  Pro  with  a  2.6  GHz  Intel  iV  processor,  8 
GB  RAM  and  a  discrete  NVIDIA  GeForce  GT  650M  graphics  card. 

The  evaluation  of  head  mounted  displays  was  quickly  narrowed  to  the  Oculus  Rift  (Figure 
5.3.)  It  is  low  cost  ($350),  easily  available,  and  due  to  growing  commercial  interest,  has 
built  in  support  for  many  software  development  platforms. 

For  interaction  with  the  virtual  environment  via  the  computer  and  a  monitor  either  the 
keyboard  and  mouse,  the  wii  controller  (Figure  5.4),  or  a  traditional  game  controller  can  be 
used. 
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Figure  5.3:  Oculus  Rift  FIMD 


Figure  5.4:  Wii  Controller 
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5.2.2  Software 

In  order  to  maximize  the  potential  usability  of  the  system,  the  analysis  determined  that  the 
software  must  be  able  to  run  on  current  Apple  and  Windows  computational  platforms,  and 
provide  built  in  support  for  the  Oculus  Rift.  The  results  of  this  evaluation  are  presented  in 
table  5.2. 

All  systems  evaluated  supported  the  Oculus  Rift.  All  but  one  of  the  systems  had  a  free 
option  but  only  two  were  available  on  Apple  OSX,  Unity  and  Unreal  Engine  4.  Each  of 
these  game  engines  are  widely  used  and  have  an  active  user  community  to  provide  tutorials 
and  answer  questions.  However,  the  Unity  engine  was  used  in  Naval  Postgraduate  School 
(NPS)  Class  MV4501  and  is  supported  by  the  staff  at  NPS.  Based  on  cost,  platform  support, 
and  familiarity.  Unity  was  selected  as  the  software  development  environment. 


Table  5.2:  Software  Comparison 


Software 

OSX 

Windows  Oculus  Support 

Cost 

Unity 

X 

X 

Yes 

Personal  Licence:  Free 

Unity  Pro  Licence:  S1500 

UDK 

■ 

X 

Yes 

Non-commercial  edncational  nse:  free 
Commercial  Use:  $99  +  25%  of  eamines 
after  the  first  $50. 000 

Unreal  4 

X 

X 

Yes 

Free  +  5%  royalty  on  revenue  over  first 
$3000  calculated  per  quarter. 

X 

Yes 

$9.90  /  month 

^■Torque  3D  ■ 

X 

Yes 

Free  and  open  source 

1 

Vizard  5 

X 

Yes 

Free:  minimal  features 

Life:  $79,  limit«»<l  frafintx: 

Development:  $3990.00 

Enterprise:  $5990.00 

5.2.3  Virtual  Environment 

The  virtual  environment  developed  is  an  interactive  flight  deck.  The  user  is  placed  standing 
between  the  bow  catapults  (Eigure  5.5)  and  directs  the  actions  taken  as  if  they  were  on  the 
flight  deck  conducting  launch  operations  from  catapult  number  one.  In  order  to  provide 
immersion  and  presence,  the  environment  is  presented  in  the  first  person  point  of  view  for 
both  the  desktop  and  head  mounted  display  options. 
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Figure  5.5:  Starting  Position 


There  are  three  main  forms  of  trainee  interaction  with  the  virtual  environment. 

In  the  first  form  of  interaction,  the  trainee  is  wearing  a  head  mounted  display  and  directing 
the  instructor  to  operate  the  system  via  hand  signals,  just  as  if  the  trainee  were  on  the 
flight  deck  signaling  the  deckedge  operator.  This  allows  the  trainee  to  perform  all  hand 
signals  just  as  they  would  on  the  flight  deck  as  well  as  providing  the  feeling  of  not  actually 
controlling  the  status  of  the  catapult  and  relying  on  the  visual  cues  provided  in  the  virtual 
environment. 

In  the  second  form  of  interaction,  the  trainee  is  wearing  a  head  mounted  display  and  utiliz¬ 
ing  the  wii  controller  to  interact  directly  with  the  virtual  environment.  This  allows  the 
trainee  to  practice  proficiency  without  an  instructor.  In  this  setup  the  trainee  can  per¬ 
form  hand  signals  in  a  slightly  modified  manner,  similar  to  those  used  when  signaling 
with  wands,  as  if  conducting  a  night  launch  operation. 

In  the  third  form  of  interaction,  the  trainee  is  seated  at  a  computer  using  the  keyboard  and 
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mouse  or  a  game  controller.  This  form  allows  for  practice  when  a  head  mounted  display  is 
unavailable  or  when  instruction  is  desired  to  be  given  to  a  group  of  trainees  by  an  instructor. 
Hand  signals  cannot  be  used  in  this  configuration. 

Following  Baldwin  and  Ford’s  recommendation  for  stimulus  variability  [9],  a  variety  of 
launch  options  are  available  to  the  trainer  who  selects  the  type  and  number  of  launch  events 
that  they  desire  to  train  in  the  virtual  environment.  This  is  accomplished  via  a  simple  text 
file  that  is  loaded  into  the  program  on  start  and  allows  for  a  pre-planned  and  repeatable 
training  scenario.  The  simple  text  file  requires  three  fields  for  each  scenario:  the  type  of 
launch,  the  headwind,  and  crosswind.  The  type  of  launch  can  be  one  of  the  following  while 
the  training  simulation  is  running: 

•  “regular”  :  a  normal  launch  with  no  unusual  circumstances 

•  “suspend”  :  a  launch  that  will  be  suspended  by  the  airboss 

•  “hangfire”  :  a  launch  that  will  end  with  a  hangfire 

•  “badcheck”  :  a  launch  that  will  be  suspended  by  the  final  checker 

•  “pitching”  :  a  launch  with  a  pitching  deck 

Additional  flexibility  is  provided  by  giving  the  instructor  the  ability  to  inject  or  modify  the 
following  scenario  elements: 

•  inject  an  airboss  suspend 

•  inject  a  final  checker  suspend 

•  inject  a  pilot  suspend 

•  inject  a  hangfire 

•  modify  the  color  of  the  bow  safety  light  to  red 

•  modify  the  headwind 

•  modify  the  crosswind 

•  modify  the  deck  pitch  (on  or  off  only) 

The  variables  that  comprise  each  step  of  the  bow  launch  scan  are  measured  by  the  pro¬ 
gram  recording  the  amount  of  time  the  objects  that  need  to  be  evaluated  in  Section  5.1  are 
observed  by  the  user.  This  observation  determination  is  made  by  sphere-casting,  which  is 
projecting  an  invisible  sphere  of  radius  0.9  from  the  users  center  of  vision  forward  until  it 
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intersects  a  collision  box,  which  is  an  invisible  box  around  the  intended  objects,  that  de¬ 
tects  when  the  sphere  impacts  the  box.  Future  testing  may  identify  the  need  to  re-size  the 
collision  boxes  or  the  sphere  radius  to  improve  accuracy.  The  starting  and  ending  values  of 
both  the  headwind  and  cross  wind  are  also  recorded  for  each  launch  scenario. 


This  data  is  presented  to  the  user  on  screen  at  the  completion  of  the  scenario  (Figure  5.6) 
as  well  as  saved  to  file  for  debriefing,  record  keeping,  and  trend  analysis. 


Figure  5.6:  Completion  Report 
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CHAPTER  6: 

Conclusions  and  Future  Work 


6.1  Conclusion 

This  research  demonstrated  that  current  launch  officer  training  conducted  solely  via  on-the- 
job  performance  in  an  under  instruction  status  leaves  training  methodologies  unexplored 
that  have  been  shown  to  be  beneficial.  The  research  conducted  on  training  transfer  tech¬ 
niques  and  the  job  task  analysis  performed  on  the  launch  officer  occupation  support  the 
claim  that  a  virtual  environment  can  provide  the  necessary  elements  needed  to  learn  and 
practice  skills  required  to  perform  launch  officer  tasks. 

This  thesis  set  out  to  answer  four  main  research  questions.  Through  research  and  building 
of  the  virtual  environment  evidence  has  been  found  that  suggests  all  of  the  questions  have 
been  sufficiently  answered.  The  questions  and  results  are  briefly  summarized  here. 

1 .  What  are  the  main  skills  required  for  an  officer  to  qualify  as  arresting  gear  officer, 
bow  catapult  officer,  and  waist  catapult  officer  that  can  be  developed  in  a  virtual  en¬ 
vironment? 

Through  the  task  analysis  conducted  with  techniques  from  the  job  duty  task  analysis, 
the  main  skills  required  as  annotated  in  Table  5.1  were  system  knowledge,  procedu¬ 
ral  knowledge,  and  situational  awareness. 

2.  Based  on  current  training  literature,  which  of  these  skills  can  likely  be  trained  effec¬ 
tively  in  a  virtual  environment? 

Chapter  3  explained  that  skills  and  knowledge  can  be  learned  in  a  virtual  environ¬ 
ment  and  then  transferred  to  the  physical  world  if  the  virtual  environment  has  an 
adequate  immersion,  presence,  and  buy-in  from  the  user  [9],  [11].  The  shooter  .skills 
required  for  all  tasks  and  knowledge  learned  through  book  study  and  classroom  in¬ 
struction  was  determined  to  be  declarative  knowledge  of  the  system.  The  prototype 
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that  was  built  reinforces  this  declarative  knowledge  but  does  not  focus  on  it.  The 
literature  shows  that  declarative  knowledge  can  be  trained  effectively  in  a  virtual  en¬ 
vironment,  however,  the  one  built  in  support  of  this  thesis,  assumes  that  a  base  level 
of  system  knowledge  would  be  acquired  prior  to  training  with  the  virtual  environ¬ 
ment.  Empirical  evidence  [19]  supports  that  the  other  three  skills  can  effectively  be 
trained  in  a  virtual  environment  like  the  one  developed  in  this  thesis.  The  objective 
and  subjective  effectiveness  of  this  prototype  environment  in  comparison  to  the  cur¬ 
rent  training  methods  have  not  been  tested  and  are  areas  for  future  work. 

3.  What  are  the  technical  attributes  a  system  needs  to  adequately  represent  the  shooter 
environment  for  training? 

The  technical  attributes  of  a  system  should  be  based  around  the  concepts  of  pro¬ 
viding  immersion,  presence  and  buy-in.  As  shown  in  the  research,  a  system  must 
have  a  level  of  fidelity  high  enough  to  immerse  the  viewer  in  the  virtual  environ¬ 
ment  and  that  environment  must  be  realistic  enough  to  convince  the  viewer  that  he 
is  present  in  that  environment.  The  system  built  provides  immersion  and  presence 
through  the  high  definition  head  mounted  display  and  flight  deck  environment  cre¬ 
ated  with  detailed  3-dimensional  models.  The  level  of  buy-in  from  the  user  for  this 
system  can  be  determined  with  future  human  testing.  The  buy-in  aspect  as  discussed 
in  prior  work  is  a  subjective  element  specific  to  each  user.  Since  the  intended  user 
is  a  flight  deck  professional,  something  represented  inaccurately,  such  as  the  final 
checker  model  may  be  enough  to  influence  buy-in  in  a  negative  way.  Future  human 
testing  must  be  performed  in  order  to  measure  these  attributes. 

4.  Do  current  and  emerging  systems  possess  the  requisite  attributes  for  use  in  a  shooter 
training  environment? 

Technology  is  rapidly  advancing  in  the  realms  of  virtual  and  augmented  reality.  The 
evidence  supports  that  the  current  systems  do  in  fact  possess  the  requisite  attributes 
to  allow  for  a  shooter  training  environment  and  the  capabilities  of  the  systems  will 
continue  to  become  more  advanced.  Current  systems  on  the  market  can  provide  a  low 
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cost,  deployable  system  that  ean  provide  a  shooter  environment  with  enough  fidelity 
to  serve  as  a  shooter  training  tool. 

By  eonstrueting  a  virtual  environment  that  not  only  fills  the  requirements  neeessary  to 
perform  the  tasks  and  skills  identified  in  the  job  task  analysis,  but  is  also  deployable  in 
a  low-eost  and  portable  form  faetor,  the  fleet  is  one  step  eloser  to  inereased  training  and 
profieieney  with  redueed  eost,  risk,  and  timeframe. 

6.2  Future  Work 

This  thesis  shows  that  it  is  possible  to  eonstruet  a  virtual  flight  deek  environment  that 
ean  provide  the  seenarios  required  to  praetiee  the  skills  for  launehing  aireraft  from  the 
CVN.  What  it  does  not  show  is  how  effeetive  the  provided  virtual  environment  is  for 
training  unqualified  shooters  in  their  tasks  or  how  effeetive  it  is  in  allowing  already  qualified 
shooters  to  praetiee  their  skills  to  maintain  profieieney.  This  thesis  is  a  first  step  towards 
realizing  a  earrier  deployable  simulation  environment  for  flight  deek  personnel,  however, 
in  order  to  realize  that  goal  additional  researeh  is  required. 

6.2.1  Human  Testing 

Although  this  thesis  presents  a  virtual  environment  that  provides  the  elements  required 
to  perform  the  tasks  required  of  the  launeh  offieer,  the  effeetiveness  of  the  environment 
in  a  training  eonstruet  was  not  eondueted.  Future  work  should  develop  a  testing  plan  to 
measure  the  training  effeetiveness  with  a  group  of  unqualified  shooters  using  this  system 
against  a  eontrol  group  not  using  this  system.  The  measures  of  effeetiveness  eould  be  the 
unqualified  shooters  performanee  on  their  qualifieation  boards  and  the  time  required  to 
train  before  they  felt  that  they  were  ready  for  their  boards.  Additionally,  the  environment 
eould  be  tested  with  qualified  shooters  in  various  stages  of  the  inter-deployment  timeline 
to  gauge  the  effeetiveness  for  maintaining  profieieney. 

6.2.2  Display  Type 

This  thesis  provided  a  virtual  environment  presented  in  two  formats,  the  desktop  and  vir¬ 
tual  reality  with  no  testing  to  determine  whieh  environment  is  more  effeetive.  Future  work 
should  investigate  the  differenee  in  effeetiveness  between  the  head  mounted  display  envi¬ 
ronment  and  the  desktop  environment.  While  this  thesis  foeused  only  on  whether  a  virtual 
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environment  was  feasible  for  training  it  treated  all  virtual  environments  as  equally  effee- 
tive  which  may  or  may  not  be  the  case.  The  results  of  this  research  will  shape  the  future 
development  of  the  training  system  for  possible  deployment  to  the  fleet. 

6.2.3  Eye  Tracking 

The  virtual  environment  that  was  developed  for  this  thesis  relied  on  sphere-casting  to  de¬ 
termine  the  amount  of  time  the  user  was  observing  the  relevant  objects  in  the  environment. 
Future  work  should  incorporate  eye  tracking  technology  within  the  selected  display  to  more 
accurately  track  where  the  user  was  focusing  their  attention. 

6.2.4  Augmented  Reality 

At  the  time  of  this  thesis,  the  AR  technology  was  not  adequate  to  build  an  AR  environment 
for  training  launch  operations  on  an  actual  flight  deck.  With  the  advancements  of  low  cost 
commercially  available  AR  systems,  future  work  could  build  and  compare  the  differences 
in  effectiveness  of  an  AR  system  to  VR  systems  like  the  one  presented  here. 
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APPENDIX  A: 
LaunchPlan.txt  Example 
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APPENDIX  B: 
Results  Report  Example 


#Shooter:  LT  Shooter  DTG:  2015-03-06  08:36:54 


Event 

#  Type  Bow 

Safety 

Deckedge 

^indgauge 

Interval 

Final  Checker  Pilot 

Event 

1  regular 

1.63 

8.00 

5.85 

4.62 

2.85 

18.92 

Initial  HW: 

22.3 

Initial  CW:  10.8 

Launch  HW: 

22.3  Launch 

CW:  10.8 

Event 

2  regular 

0.20 

14.18 

6.03 

2.33 

3.93 

18.08 

Initial  HW: 

22.3 

Initial  CW:  10.8 

Launch  HW:  22.3  Launch  CW:  10.8 
Instructor  Injects 

*jf:***3|c**>|e**3|c>|e*3|cs|e********  END  OF  REPORT  3!c***5f:*5K****s|c**3»c**3tc***>|c>l<5|c 
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